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ABSTRACT 

The  rate  of  convergence  of  the  expected  value  of 
quantile  estimates  using  a  stochastic  approximation  with 
the  maximum  transformation  is  evaluated.   The  analysis  is 
performed  using  linear  regression  techniques  on  computer 
simulation  results  for  quantile  estimates  of  the  unit 
exponential  distribution.   Included  is  a  discussion  on  the 
use  of  the  jackknife  technique  to  reduce  the  bias  of  the 
stochastic  approximation  quantile  estimates.   Simulation 
results  for  the  2-fold  jackknife  for  the  m  '   term  are 
tabulated.   The  main  conclusion  of  the  analysis  is  that 
the  lowest  order  term  in  the  expression  for  the  expected 

value  of  the  estimate  as  a  function  of  sample  size  decreases 

-.25 
as  m 
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I.   INTRODUCTION 

The  problem  of  estimating  quantiles  may  be  found  in 
numerous  statistical  applications.   (The  a   quantile  S 
for  the  distribution  of  the  random  variable  S,  F(s),  is 
defined  as  S   =  F    fa),  0  <  a  <  1,  and  is  assumed  to  be 
unique).   The  increased  use  of  computer  system  simulations 
provides  some  practical  examples.   In  certain  cases  the 
quantile  estimates  from  the  generated  data  may  be  the  direct 
measures  used  to  evaluate  the  system.   In  other  applications 
one  might  find  it  practical  to  characterize  the  distribu- 
tion function  of  variables  at  different  points  in  a  system 
using  several  statistics  such  as  quantiles.   The  practica- 
bility of  this  latter  example  may  be  dictated  by  the  size 
of  the  simulation  and  the  number  of  replications  performed. 
In  any  case,  the  need  for  efficient  quantile  estimates 
exists . 

Two  possible  solutions  to  the  problem  of  quantile 
estimation  are  the  order  statistic  estimate  (S  f  m) )  and 
the  stochastic  approximation  estimate  (§  (m)-)  of  Robbins- 
Monro  (1951)  where  m  is  the  sample  size.   These  methods 
each  have  their  benefits  and  limitations  which  warrant 
comparison.   In  this  regard,  the  increased  use  of  computer 
simulations  dictates  that  the  comparative  efficiency  of 
these  methods  not  be  based  solely  on  statistical  efficiency 
but  computational  efficiency  as  well.   The  term  computational 
efficiency  refers  to  the  time  and  cost  of  programming, 


debugging,  computing,  and  data  storage  requirements  in  the 
application  of  a  given  estimation  scheme. 

Goodman,  Lewis  and  Robbins  (1973)  used  these  considera- 
tions in  a  comparative  analysis  of  the  order  statistic 
estimate  and  the  stochastic  approximation  estimate  with 
the  maximum  (minimum)  transformation  in  estimating  extreme 
quantiles  (e.g.,  quantiles  corresponding  to  probability 
levels  a  =  0.999).   The  maximum  transformation  is  a  device 
which  they  utilized  to  alleviate  the  problem  of  the  appar- 
ently very  slow  convergence  of  the  stochastic  approximation 
when  applied  to  extreme  quantiles.   They  also  indicated  the 
possible  existence  of  similar  problems  in  highly  skewed 
distributions  even  for  moderate  quantiles  (e.g.,  a  =  0.90). 

The  considerations  for  selecting  the  maximum  transfor- 
mation above  other  possible  techniques  are  discussed  by 
Goodman,  Lewis,  and  Robbins  (1973).   The  benefits  are  that 
it  does  not  require  special  information  about  the  random 
variable  from  which  the  sample  is  taken  to  estimate  the 
quantile.   This  kind  of  information  would  be  required  in 
deriving  bounds  to  the  quantile  estimate  to  alleviate  the 
problem  of  very  slow  convergence.   The  maximum  transforma- 
tion is  also  computationally  efficient  in  that  it  requires  a 
single  memory  cell  and  a  limited  number  of  binary  comparisons 
These  requirements  are  much  simpler  and  less  time  consuming 
than  the  scheme  proposed  by  Kesten  (1958)  to  alleviate 
the  problem  of  long  runs.   Finally,  if  the  maximum 
transformation  to  the  median  (a'  =  0.5)  is  used, 


Cochran  and  Davis  (1965)  have  shown  (using  simulations) 
that  the  stochastic  approximation  works  well  for  this  value 
of  a'.   The  maximum  transformation  is  used  to  transform 
higher  quantiles  a  >  0 . 5  to  a '  =  0 . 5  and  the  minimum  trans- 
formation used  where  a  <  0.5. 

The  conclusions  of  Goodman,  Lewis,  and  Robbins  (1973) 
were  that  the  stochastic  approximation  with  maximum  trans- 
formation provides  a  practical  alternative  to  the  problem 
of  extreme  quantile  estimation.   It  is  computationally 
efficient;  computing  time  is  linearly  dependent  on  sample 
size  (m)  and  storage  requirements  are  small  and  fixed. 
Statistically,  the  estimate  was  relatively  free  of  bias 
although  there  existed  some  increase  in  the  variance  of 
the  estimate.   Also  included  in  their  report  were  the 
results  of  the  application  of  the  jackknife  for  a  presumed 
m   term  in  the  bias  to  the  stochastic  approximation 
scheme.   Their  simulation  results  indicated  that  conver- 
gence was  slower  than  m   and  they  conjectured  the  possible 
existence  of  an  m  '   bias  term.   This  implied  the  possibility 
of  further  improving  the  stochastic  approximation  with 
maximum  transformation  using  the  appropriate  jackknifing 
procedure.   It  was  this  conjecture  that  prompted  the 
analysis  for  this  paper. 


II.   PROBLEM  AND  APPROACH 

The  problem  approached  was  to  evaluate  the  rate  of 
convergence  of  the  stochastic  approximation  with  a  maximum 
transformation  with  the  intent  to  further  improve  the 
stochastic  approximation  with  the  jackknife  method  of  bias 
reduction  proposed  by  Quenouille  (1956) .   A  secondary 
problem  was  to  evaluate  Turkey's  assertion  that  the  sample 
variance  of  the  "pseudo-values"  used  in  forming  the  jack- 
knifed  estimate  could  be  used  to  estimate  the  variance  of 
the  estimate,  i.e.,  Var(S  (m) ) . 

The  approach  taken  to  solve  the  problem  consisted  of 
two  basic  steps.   Initially,  a  preliminary  analysis  was 
made  on  the  data  obtained  by  Goodman,  Lewis,  and  Robbins 
(1973)  to  determine  if  the  bias  was  of  the  order  0 (m  '  ) 
rather  than  0 (m   ).   The  linear  least  square  computer  pro- 
gram of  Daniel  and  Wood  (1971)  was  used  to  accomplish  this 
analysis.   Once  the  order  of  the  bias  term  was  determined, 
a  computer  simulation  was  used  to  evaluate  the  effect  of 
the  jackknife  on  the  rate  of  convergence  and  the  variance 
of  the  stochastic  approximation  estimate  with  maximum 
transformation  and  to  determine  if  the  sample  variance  of 
the  pseudo-values  could  be  used  to  estimate  the  variance 
of  the  quantile  estimate.   The  distributions  and  quantiles 
selected  for  analysis  were  the  unit  exponential  0.5,  0.9, 
0.95,  0.975,  and  0.999  quantiles  and  the  uniform  (0,1)  0.5 
quantile.   Initially,  the  simulation  was  programmed  to 


achieve  an  m-fold  jackknifed  estimate  but  was  subsequently 
modified  to  the  2-fold  jackknife  for  reasons  discussed 
later  in  the  paper. 


III.   LINEAR  REGRESSION 

The  preliminary  analysis  in  evaluating  the  rate  of 
convergence  of  the  stochastic  approximation  with  maximum 
transformation  was  accomplished  using  a  regression  analysis 
on  the  original  data  obtained  by  Goodman,  Lewis,  and 
Robbins  (1973) .   This  data  consisted  of  12  points  covering 
reduced  sample  size  values  from  m '  =  8  to  60,  where 
m1  =  m/v  and  v  is  a  constant  computed  for  the  maximum 
transformation,  with  corresponding  values  of  the  mean  and 
variance  of  the  stochastic  approximation  estimates  with 
maximum  transformation  both  with  and  without  jackknife. 
The  data  used  for  the  regression  analysis  was  for  the  0.999 
quantile  estimates  of  the  unit  exponential  distribution. 

Two  equations  were  fitted  to  the  data  to  substantiate 
the  existence  of  a  term  of  lower  order  than  m  .  In  each 
case  a  weighted  linear  regression  was  used  to  account  for 
the  variability  of  the  variance  over  the  range  of  sample 
values.  The  weighting  factor  used  was  the  inverse  of  the 
sample  variance. 

The  initial  regression  was  applied  based  on  a  logarith- 
mic transformation.   The  regression  equation  used  was 

ln(bias)  =  ln(a)  -  ln(m')  ,  (3.1) 

where  the  values  of  the  bias  were  computed  as 


b  =  E(S  (m'))  -  S  (3.2) 

K   aK      J  J  a 


and 


6  =  E(S  (m'))  -  S  (3.3) 

a         a 


for  the  data  without  and  with  jackknife  respectively. 
If  the  bias  is  such  that  b  =  am  ^  and  higher  order  terms 
can  be  neglected,  then  the  coefficients  obtained  from  the 
regression  will  provide  a  direct  estimate  of  y.   An  obvious 
problem  exists  if  the  bias  contains  secondary  terms  that 
are  significant.   In  that  case  the  estimate  y  will  be  incor- 
rect since  the  effect  of  secondary  terms  are  not  distinguish- 
able under  the  logarithmic  transformation.   Consequently,  a 
second  equation  was  also  applied  using  multiple  independent 
variables  to  check  the  significance  of  any  secondary  terms. 
The  second  regression  equation  used  was 

bias  =  am"Y  +  bm"  Y  +  cm"  y  ,  (3.4) 

where  y    is  considered  a  known  constant  to  preclude  the 
requirement  for  a  non-linear  regression.   The  inherent 
problem  with  applying  equation  3.4  with  a  linear  regression 
is  that  an  estimate  or  guess  of  y  is  required.   To  achieve 
this  estimate  the  results  of  the  initial  regression  in  con- 
junction with  the  conjecture  that  y  =  0.5  were  evaluated  to 
derive  an  estimate  for  implementing  the  regression  using 
Equation  3.4. 
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IV.   JACKKNIFE 


Based  on  the  assumption  that  the  bias  of  the  ruantile 
estimate  S  (m)  is  of  the  form 

E(Sa)  -  Sq  =  am"Y  +  bm"2y  +  0(m~3y),        (4.1) 

the  jackknife  technique  can  be  applied  to  obtain  an  estimate 
S  (m)  with  a  bias  free  of  the  m   term: 


a 


'm"2Y  +  n(m'3y' 


E(S  )  -  S   =  b'm  "'  +  0(m   ')  .  (4. 2) 

v  or     a  *■     *  v    J 

The  initial  approach  to  applying  the  techniques  was 
with  the  m-fold  jackknife.   Let  S  (m)  be  the  esti.mate  based 
on  all  m  sample  values  and  S  (m-1).,  i=l,...,m,  b>e  the 
estimate  based  on  m-1  sample  values  obtained  by  emitting 

the  ith  value.   Then  consider  the  the  pseudo- valets  S  (m)  -  , 

r  a    l 

i=l,...,m,  computed  as 

S  (m) .  =  A-S  (m)  +  B-S  (m-1).     (i=l , . . . ,m) ,      (4.3) 
The  jackknifed  estimate  S   is  then  computed  as  th  £  average 


a 


of  the  m  pseudo  values 


m 


S   =  E(S  (m))  =  I      S  (m) ./m.  (4.4) 

From  equations  4.1,  4.3,  and  4.4,  if  A  and  B  are  .-elected 
such  that 

A  =      mY   -     and  B  -  -    Cm-l)*     ,       (4.5) 
mY  -  (m-l)T  mY  -  (m-l)Y 
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then  the  jackknifed  estimate  will  have  a  bias  which  is 
0(hT2y),  or 

B(50)  -  Sa  -  -     b     +  0(m-3Y).  (4.6) 

m1  (m-1) ' 

In  the  present  case  where  y    is  assumed  to  be  0.5  the  values 
of  A  and  B  used  in  the  simulation  were 

A  =  M  and   B  -  -  —iSZH .         (4.7) 

/m  -  /(m-1)  /m  -  /(m-1) 

The  2-fold  jackknife  is  computed  with  the  modification 
that  the  sample  is  partitioned  into  two  disjoint  sections 
with  S  (m/2) . ,  i=l,2,  computed  from  the  ith  section  of  half 

U>         1 

the  sample  values.   Equations  4.3  and  4.4  then  reduce  to 

S  (m)1  =  A-S  (m)  +  B-S  (m/2),  ,  (4.8) 

a  v  '  1      aK   J  a v    J 1  '  ^    J 


S  fm)0  =  A-S  (m)  +  B-S  (m/2),,  ,  (4.9) 


and 


(S  (m) .  +  S  (m) _)  f.    1A. 

^     v  a K    J 1 a v  ^  2J  (4.10) 

ba  2         * 


There  is  a  problem  here  in  that  it  is  possible  to  segment  the 
sample  into  two  disjoint  sections  in  many  ways;  in  what 
follows  the  sections  were  the  first  and  second  halves  of 
the  data. 

The  values  of  A  and  B  required  to  achieve  the  reduction 
in  bias  then  become 

?Y                     1 
A  =  1 and   B  = .  (4.11) 

(2Y  -  1)  (2Y  -  1) 
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The  resulting  jackknifed  estimate  then  is  biased  as  0(m~   ), 
or  specifically 

E(U  "  Sa  =  (2\~    2   Y)  ^/^)    +  0(^"3y)  •        (4-12) 


Based  on  the  assumption  y   =  0.5  the  values  for  A  and 
B  are 

A  =  — SI and   B  =  - ,  (4.13) 

(/I  -  1)  (/2  -  1) 

with  the  result  that  the  jackknifed  estimate  has  the  form 

E(S  )  =  S   +  (/?  "  2)  (b/m)  +  OCm"1'5)  .      (4.14) 
a      a    (/2  -  1) 

These  calculations  indicate  that  if  the  jackknife  is 
performed  for  the  correct  term,  the  resulting  estimate 
should  converge  more  rapidly  but  with  a  negative  bias. 

A  logical  question  that  arises  is  what  are  the  conse- 
quences of  applying  the  jackknife  for  an  erroneous  term, 

-  8 
say  m   .   Considering  the  true  bias  to  be  of  the  form  in 

a  o 

equation  4.1  and  applying  the  jackknife  with  A  =  2  /(2   -  1) 
and  B  =  -1/(2   -  1)  the  resulting  estimate  will  have  the 
form 

E(U  =  Sa    +    (2fi  "  2  }  (b/mY)  +  0  (m"2Y)  •     (4-15) 

This  result  indicates  that  if  the  true  bias  is  of  the  form 
m  Y  such  that  y    >    8,  where  8  is  the  power  of  the  term  being 
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jackknifed,  the  resulting  estimator  should  remain  biased 
with  leading  term  still  decreasing  as  m  y  but  with  a 
coefficient  k  =  (23  -  2Y)/(23  -  1)  <  0.   Similarly,  if 
y  and  3  are  such  that  y  <  3  and  cy  =  3  where  c  is  some 
positive  integer  then 

E(S  )  =  S   +  ka/mY  +  0(m"2y)  -  0(m~CY)  .       (4.16) 

Consider  the  case  where  y  =  0.5  and  the  jackknife  is 
applied  for  the  m   term  (3  =  1) .   The  resulting  estimator 
will  be  biased  and  of  the  form 

E(S  )  =  Sa  +  .586  am''5  +  0(m~1,5)  .        (4.17) 

Thus  there  is  a  reduction  in  the  magnitude  of  the  m  * 
term  in  the  bias,  but  the  leading  term  is  still  of  the 
same  order  as  before. 

Casual  inspection  of  the  simulation  results  in  Goodman, 
Lewis,  and  Robbins  (1975)  indicates  that  the  bias  is  decreasing 
slower  than  m   .   If  the  leading  term  is  in  fact  m  *  ,  the 
effect  of  the  jackknife  is  precisely  as  in  Equation  4.17. 
The  bias  results  obtained  by  Goodman,  Lewis,  and  Robbins 
(1973)  are  shown  in  Figure  1. 

In  the  next  sections  the  two  types  of  quantile  estima- 
tion are  discussed  in  more  detail. 
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V.   QUANTILE  ESTIMATE:   ORDER  STATISTIC 

The  order  statistic  estimate  S   can  be  obtained  by 

ordering  the  sample  and  using  Srr      -, .  as  the  order 
to        r  ( [am] J 

statistic  estimate  S  ,  where  [am]  is  the  greatest  integer 
less  than  or  equal  to  am  and  S , . .  is  the  ith  ordered  value. 

The  distribution  and  density  function  of  the  ordered 
sample  are: 

m  (m\  k  m-k 

F  f n  (s)  =   Z  \k)     [F(s)]K  [1  -  F(s)]m  K       (5.1) 

bUJ      i=1 

fs(i)  (s)  =  (i)  i  [FCs)]1"1  [1-FCs)]111"1  f(s).   (5.2) 

For  the  uniform  distribution  (0,1)  the  mean  and  variance 
of  the  order  statistic  then  become 

E(S(i))  -  i/(m+l)  ,  (5.3) 

and        Var(S(i))  =  i(m-i+l)/{(m+l)(m+2)}.  (5.4) 

If  the  sample  size  m  is  such  that  am  is  equal  to  an  integer, 

then  S   =  S,r   ,.  and  equations  5.3  and  5.4  become 
a     ([am])       n 

E(S  )  =  m/(m+l)  =  a  -  [a/(m+l)]  (5.5) 

and       Var(S  )  =  am(m-am+l)/{(m+l)2(m+2)}  .         (5.6) 

Results  using  equations  5.5  and  5.6  are  tabulated  in  Table  1 
for  the  uniform  (0,1)  0.5  quantile. 
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Cox  and  Lewis  (1966),  using  direct  methods,  arrived 
at  the  following  results  for  the  unit  exponential  distribu- 
tion 

B(S0J  =  -ln(l-a)  -  ^  (^)  ♦    1   [^'"jz'1]  +  OC""3)   (S.7) 

12m    (1-aJ 

and   Var(S  )  -     «    -  -^  [— L_ 7  -  1]  *  OCm"3).      (5.8) 

These  equations  were  used  to  compute  the  results  in 

Tables  2  through  6  for  the  unit  exponential  0.5,  0.9,  0.95, 

0.975,  and  0.999  quantiles. 
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VI.   QUANTILE  ESTIMATE:   STOCHASTIC  APPROXIMATION 

The  maximum  transformation  was  used  with  the  stochastic 

approximation  in  estimating  extreme  quantiles  to  alleviate 

the  problem  of  slow  convergence,  as  previously  discussed. 

To  implement  the  maximum  transformation  consider  the  sample 

S- ,  i=l,...,m,  from  the  distribution  F(s) =prob (S=l)  from 

which  the  extreme  quantile  S  ,  a  >  0.5,  is  to  be  estimated. 

If  the  sample  is  partitioned  into  subsets  of  v  values  each 

(assuming  m'=m/v)  and  the  maximum  value  is  taken  from  each 

of  the  m'  subsets  the  result  is  a  reduced  sample  S',,...,S'  , 

The  distribution  of  the  random  variable  in  the  reduced 

sample  F    (s)  is  then  given  by 
r    max  ^    J  fe      ! 

F    (s)  -  FV(s)  =  aV  =  a'  (6.1) 

max v  '  K    J  K 

and  consequently  S  '  =  S  .  . 

This  result  implies  that  if  the  transformation  to  the 
median  a'  =  0.5  is  used,  and  v  is  chosen  such  that 
v  =  In  (a ')  /.ln(a)  ,  then  the  stochastic  approximation  can 
be  used  to  estimate  the  median  quantile  S  '  =  .5  of  the 
reduced  sample  S,'  ,  .  .  .  ,  S*,  which  is  equal  to  the  extreme 
quantile  S   from  the  original  sample. 

The  primary  distribution  used  in  the  simulation  was 

-  s 
the  unit  exponential  distribution,  F(s)  =  1-e   .   To  mini- 
mize the  computing  time  of  the  program  the  maximum  transfor- 
mation was  simulated  by  generating  the  reduced  sample 
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directly.   Since 


Ws)  ■  Cl-e"5)V  -  r   0  <  r  <  1, 


(6.2) 


solving  for  s  gives 


s  =  -ln(l-r1/v) 


(6.3) 


Hence,  mT  pseudo-random  numbers  r, ,...,r  ,  were  generated 

1      m' 

and  the  reduced  sample  S'...,S'  ,  was  computed  directly 
using  equation  6.3  (i.e.,  Sj  =  -ln(l-r,  /v)  ,  etc.).    This 
procedure  saved  considerable  computing  time,  if  v  is  much 
greater  than  10,  by  reducing  the  number  of  pseudo  random 
numbers  required  from  m  down  to  m'  =  m/v.   The  values  of 
the  parameters  used  in  the  simulation  are  listed  in  the 
following  table. 


a 

0.5 

0.9 

0.95 

0.975 

0.999 

V 

1 

7 

14 

27 

700 

a' 

0.5 

0.47830 

0.48768 

0.50481 

0.49641 

The  stochastic  approximation  was  then  applied  to  the 
reduced  sample  to  obtain  the  estimate  S  ,(mT)  which  is  the 
value  obtained  on  the  m'th  iteration  using  the  following 


The  random  number  generator,  RANDOM,  used  was  an 
adaptation  of  the  generator  reported  in  Lewis,  P.A.W., 
Goodman,  A.S.,  and  Miller,  J.  M. ,  MA  Pseudo-Random  Number 
Generator  for  the  System/360,"  IBM  Systems  Journal,  v. 8, 
No.  2,  1969   The  generator  was  modified  by  G.  V.    Learmonth 
to  produce  double  precision  pseudo- random  numbers  and  a  shuf- 
fling scheme  implemented  to  improve  the  randomness  of  these 
numbers.   Copies  of  the  program  may  be  obtained  from 
G.  P.  Learmonth. 
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equation 


S  ,  (i) 


l-sgn{S!-S   (i-1)} 

S  ,  (i-1)  -  %   [ 1— St 

a'  ^    J         1  L         2 


a'] 


(6.4) 


where  the  function  sgn(x)  assumes  the  value  1  if  x  >  0  and 
0  if  x  <  0,  C  is  the  inverse  of  the  density  f  (s  ,),  and 


a 


S  ,(0)  is  an  arbitrary  starting  value. 

The  initial  values  of  C  and  S  , (0)  were  obtained  using 
the  first  three  sample  values  S ' ,  S',  and  S'  from  the 
reduced  sample.   These  values  were  ordered  to  get  SI--.-,, 
SJ.-.,  and  S'  ..   The  following  approximations  were  then 
used  for  C  and  S  , (0)  . 


C  = 


8[(S(2)  "  S(1))(S(3)  "  S(2))] 


st^rr  and  V(0)  =  s(2)'  (6-5) 


(2) 
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VII.   RESULTS  AND  CONCLUSIONS 

The  results  of  the  linear  regression  on  the  0.999 
quantile  estimates  for  the  unit  exponential  distribution 
without  jackknife  in  Goodman,  Lewis,  and  Robbins  (1973) 
provided  some  evidence  that  the  term  of  lower  order  than 
m   did  exist.   The  results  using  equation  3.1  were 

bias  =  20.4m"*697  (7.1) 

and  from  equation  3.4  the  results  were 

bias  =  2.328m"*5  +  93.67m"1  .  (7.2) 

From  equation  7.2  it  was  apparent  that  the  m  '   term  was 
significant  in  the  bias  of  the  estimate  even  though  the 
value  y  =  0.5  was  based  on  a  conjecture  only  partially 
substantiated  by  the  results  in  equation  7.1.   The  result 
that  *9  =  0.697  can  be  partially  accounted  for  by  the  fact 
that  the  m   term  is  still  a  significant  factor  at  the 
sample  values  considered.   The  results  of  the  linear 
regression  on  the  jackknifed  data  in  Goodman,  Lewis,  and 
Robbins  (1973)  did  not  provide  any  additional  insight 
into  the  rate  of  convergence  of  the  quantile  estimate. 

Although  these  results  were  not  conclusive  in 
establishing  the  exact  order  of  the  bias,  they  did  tend 
to  support  the  conjecture  that  the  higher  order  term  was 
m"   .   It  was  therefore  decided  to  extend  m'  out  to  a  value 
of  200  and  jackknife  for  a  m  '   term. 
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The  simulation  was  initially  programmed  to  achieve  an 
m-fold  jackknife.   However,  results  of  the  simulation  were 
that  the  variance  of  the  estimate  tended  to  increase  above 
a  practical  level.   The  variance  of  the  jack'knifed  estimate 
for  the  0.999  quantile  of  the  unit  exponential  distribution 
was  as  much  as  100  times  higher  than  that  of  the  stochastic 
approximation  without  the  jackknife.   These  results  are 
listed  in  Table  7  and  may  be  compared  with  the  final 
results  of  the  2-fold  jackknife  listed  in  Table  19  for  the 
same  quantile.   It  was  thus  concluded  that  without  some 
kind  of  data  transformation  the  m-fold  jackknife  was 
impractical.   Consequently,  the  program  was  modified  to 
investigate  the  2-fold  jackknife. 

The  variance  reduction  technique  using  control  variables 
as  discussed  by  Gaver  (1969)  was  initially  programmed  into 
the  simulation  in  an  effort  to  reduce  the  run  time  required 
to  achieve  a  reasonable  value  for  the  variance  of  the 
estimate.   The  control  variable  used  was  the  number  of 
sample  values  from  the  reduced  sample  that  exceeded  S 
divided  by  m '  the  total  number  of  sample  values.   The 
result  was  that  a  reduction  of  approximately  20  per  cent 
for  the  variance  of  the  estimate  of  the  expected  value  of 
the  quantile  estimate  without  the  jackknife  was  achieved. 
However,  the  effect  on  the  variance  of  the  estimate  of  the 
expected  value  of  the  jackknifed  estimate  was  negligible. 

Converting  the  program  from  the  m-fold  to  the  2-fold 
jackknife  precluded  the  evaluation  of  Tukey's  idea  of 
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estimating  the  variance  of  the  quantile  estimate  using  the 
variance  of  the  pseudo-values.   This  assertion  is  based  on 
the  premise  that  the  distribution  of  the  pseudo-values 
tends  to  normality  and  that  the  pseudo-values  are  approxi- 
mately uncorrelated.   However,  results  from  the  data 
obtained  by  Goodman,  Lewis,  and  Robbins  (1973)  for  the 
coefficients  of  skewness  and  excess  of  the  estimates  obtained 
via  a  stochastic  approximation  tend  to  negate  the  assumption 
of  a  normal  distribution.   These  results  are  plotted  in 
Figures  2  and  3.   If,  as  the  theory  of  stochastic  approxi- 
mation asserts,  the  asymptotic  distribution  is  normal,  the 
convergence  is  very  slow.   It  would  therefore  appear  that 
using  the  pseudo-values  to  estimate  the  variance  would  not 
be  fruitful  in  the  present  application  of  the  jackknife 
without  some  kind  of  normalizing  transformation.   It  may 
be  that  the  basic  problem  is  the  correlation  between  pseudo- 
values,  not  the  lack  of  normality;  but  this  has  not  been 
investigated. 

The  final  simulation  was  programmed  to  compute  the 
stochastic  approximation  with  maximum  transformation  with 
and  without  a  2-fold  jackknife  for  the  m  '   term.   The 
results  for  the  unit  exponential  0.5,  0.9,  0.95,  0.975,  and 
'  0.999  quantile  and  the  0.5  quantile  of  the  uniform  (0,1) 
distribution  are  listed  in  Tables  8  through  19  with  plots 
of  the  estimated  bias  versus  sample  size.   The  remaining 
evaluation  is  based  on  the  results  obtained  for  the  unit 
exponential  distribution. 
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In  each  case  the  jackknife  estimate  was  negatively 
biased  as  predicted  from  equation  4.14.   However,  evalua- 
tion of  the  0.5  quantile  data  (Table  11)  indicates  that  the 

-  289 
resulting  rate  of  convergence  to  be  on  the  order  of  m 

Further,  successive  regressions  on  the  points  in  the  tail 

of  the  curve  indicate  that  the  value  of  y    is  decreasing, 

possibly  to  y   =  0.25.   Also,  the  sample  bias  obtained  for 

the  0.5  quantile  goes  negative  at  a  sample  size  value 

between  192  and  200  which  negates  the  assumption  that  the 

coefficients  in  equation  3.4  are  positive. 

The  results  support  the  conjecture  that  a  m  '   term 

was  significant  in  the  bias.   However,  it  also  appears  that 

there  exists  a  lower  order  term,  probably  of  the  order 

-  25 
m  '   .   This  would  imply  that  the  bias  may  be  of  the  form 

bias  =  am"*25  +  bm~  *  5  +  cm"'75  +  dm"1  +  OO"1'25).   (7.3) 

A  weighted  linear  regression  using  this  equation  was 
performed  on  the  data  for  the  unit  exponential  a  =  0.5 
quantile  without  jackknife  listed  in  Table  10.   The  resulting 
estimates  for  the  leading  four  terms  were  a  =  -0.0501824, 
b  =  0.0251160,  c  =  0.790984,  and  3  =  -0.667208.   The  values 
of  the  observed  bias,  bias  estimated  from  the  equation  fit 
by  the  weighted  linear  regression  and  the  residuals  are 
listed  in  Table  20.   The  equation  fit  achieved  a  multiple 
correlation  coefficient  squared  of  .9999.   Note  that  the 

simulation  for  this  term  is  very  large  (390,000  replications) 

2 
so  that  such  a  large  value  of  R   is  not  surprising. 
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If  the  conjecture  that  the  bias  is  of  the  form  in  7.3 
is  true,  the  bias  computed  as  a  result  of  the  jackknife 
for  the  m  '   term  would  be 

bias  =  +. 544am''25  -  ,648cm"'75  -  1.41dm"1  +  OCm"1'25^,  (7.4) 

which  is  consistent  with  the  results  obtained. 

-  2  5 
A  jackknife  for  the  m     term  would  result  in  a  bias 

of  the  form 

bias  =  -1.19bm~*5  -  2.609cm'*75  -  4.29dm"1  +  0(m"1,25),  (7.5) 

which  would  indicate  that  the  magnitude  of  the  resulting 

bias  may  be  a  large  negative  value  and  converge  as  m  '  . 

-  25 
In  fact,  a  pilot  run  to  jackknife  the  m  "    term  gave 

results  with  a  large  negative  bias  and  converging  approxi- 
mately as  m  *  .   These  results  are  plotted  in  Figure  10. 
The  pilot  run  consisted  of  120,000  replications  for  the 
a  =  .5  quantile  of  the  unit  exponential  distribution. 

An  informal  analysis  of  these  results  indicated  that 
the  rate  of  convergence  was  on  the  approximate  order  of 
m  '  .   These  results  appear  to  conform  fairly  well  with  the 
results  predictable  from  equation  7.5.   It  would  therefore 
appear  that  the  form  of  the  bias  of  the  stochastic  approxi- 
mation with  maximum  transformation  may  be  of  the  form  in 
equation  7.3. 

If  the  form  of  the  bias  is  in  fact  of  the  form  in  7.3, 

a  possible  approach  would  be  to  jackknife  for  both  the 

-  5      -  25 
m    and  m     terms.   This  could  be  accomplished  by  using 
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as  pseudo-values 

S-.  =  A-S  fm)  +  B-S  (m/2).  +  OS  (m/4)  .    i,  j=l ,  2    (7.6) 

where  S  (m)  and  S  (m/2) .  are  as  previously  discussed  and 

S  (m/4) . .  is  computed  by  partitioning  the  ith  subset  of 

m/2  values  into  two  disjoint  subsets  of  m/4  values  each. 

Then  S  (m/4) . .  is  the  estimate  based  on  the  values  in  the 
aK        J  ij 

jth  subset  from  the  ith  half  sample  set. 
The  jackknifed  estimate  then  becomes 

z  [S    +  S   +  §    +  S   ] 

S   =  — — ^—A — ^-  (7.7) 

a  4 

with  the  result  that  if  A,  B,  and  C  are  chosen  as 

A  =  1-B-C,  (7.8) 

B  =  -  (1  +  C  /2-l)/(2"-25  -  1),  (7.9) 

C  =  (/2-2"*25)/[2"*25  -  1  -  (/2-1)2],  (7.10) 

then 

E(Sa)  -  Sa  =  -1.68cm"*75  +  6.06dm"1  +  0(m"1,25),    (7.11) 

-  25      -  5 
which  is  void  of  the  m  '    and  m  *   bias  terms.   This  may, 

of  course,  inflate  the  variance  of  the  estimator  to  an 

unacceptable  level. 

In  conclusion,  an  assessment  of  the  utility  of  the  method 

for  obtaining  an  extreme  quantile  discussed  in  this  thesis 

can  be  made  by  referring  to  Figures  11  and  12.   These  show 

the  standard  deviations  and  root  mean  square  errors  of  the 
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" 


order  statistic  estimate,  stochastic  approximation  estimate 
with  maximum  transformation  (with  and  without  jackknife)  as 
a  function  of  the  sample  size. 

There  is  clearly  an  increase  in  the  standard  deviation 
of  the  quantile  estimate,  for  all  m,  as  one  goes  from  the 
estimate  based  on  order  statistics  to  the  stochastic  approxi 
mation  estimate  and  then  to  the  stochastic  approximation 
with  jackknife.   However,  this  is  more  than  offset  by  the 
(fixed)  smaller  memory  requirements  for  the  stochastic 
approximation  estimate  and  the  fact  that  the  time  needed 
to  obtain  an  estimate  from  a  sample  of  size  m  is  propor- 
tional to  m,  while  the  order  statistic  estimate  requires 
memory  proportional  to  m  and  time  (to  order  the  data) 
proportional  to  mlog (m) .   These  factors  become  even  more 
critical  when  considered  in  the  context  of  estimating 
large  numbers  of  quantiles  or  in  cases  where  m  is  large 
(see  Goodman,  Lewis,  Robbins,  1973). 
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